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Load balancing is crucial to ensure scalability, reliability, minimize response 
time, and processing time and maximize resource utilization in cloud 
computing. However, the load fluctuation accompanied with the distribution 
of a huge number of requests among a set of virtual machines (VMs) is 
challenging and needs effective and practical load balancers. In this work, a 
two listed throttled load balancer (TLT-LB) algorithm is proposed and further 
simulated using the CloudAnalyst simulator. The TLT-LB algorithm is based 
on the modification of the conventional throttled load balancer (TLB) 
algorithm to improve the distribution of the tasks between different VMs. The 
performance of the TLT-LB algorithm compared to the TLB, round robin 
(RR), and active monitoring load balancer (AMLB) algorithms has been 
evaluated using two different configurations. Interestingly, the TLT-LB 
significantly balances the load between the VMs by reducing the loading gap 
between the heaviest loaded and the lightest loaded VMs to be 6.45% 


compared to 68.55% for the TLB and AMLB algorithms. Furthermore, the 
TLT-LB algorithm considerably reduces the average response time and 
processing time compared to the TLB, RR, and AMLB algorithms. 
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1. INTRODUCTION 

Cloud computing has emerged as a durable and evolving paradigm that offers massive opportunities 
for the information and communication technology industry. It is a powerful distributed computing platform 
for several indispensable applications including financial accounting feature [1], health care systems [2], 
meteorological prediction [3], networking, file storage and sharing as well as data collections [4], just to name 
a few. These potential applications of cloud computing are due to its several merits, such as resource 
maximization, customization, fast response to business needs, scalability, elasticity, off-site access, and cost- 
saving compared to hardware systems [5]. 

The cloud computing environment comprises three main layers, namely infrastructure as a service 
(IaaS), platform as a service (PaaS), and software as a service (SaaS) [6]. The basic layer of cloud computing 
is the infrastructure layer, where the cloud offers shared hardware needed for the users. In IaaS, the 
virtualization software controls the access of users to partition and multiplex physical resources such as CPU, 
memory, I/O, storage, and network resources [7]. However, access of several thousands of users to a cloud data 
center (DC) leads to overloading, power consumption, and longer response time that could end up with a system 
failure. 
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Load imbalancing is one of the major issues that restrict the development of cloud computing 
technology and still need to be addressed. Consequently, designing and applying a practical load balancing 
system to manage the workloads is of particular interest. An efficient load balancing algorithm is characterized 
by a decrease in the loading gap between the heaviest loaded and the lightest loaded virtual machines (VMs), 
with enhanced resource utilization [8]. Moreover, it reduces the average required processing time and response 
time, which is essential for performing the received tasks in cloud DCs [9]. In this respect, several load- 
balancers have been proposed considering the aforementioned aspects [10]-[22]. Among the algorithms, round 
robin (RR), active monitoring load balancer (AMLB), throttled load balancer (TLB) are common load 
balancing algorithms in large-scale cloud environment using cloud simulator [23]—[29]. 

Load balancing algorithms can be categorized into static and dynamic algorithms [24]. Static 
algorithms such as the RR algorithm are typically suitable for a stable and homogeneous environment [30], 
[31]. On the other hand, dynamic algorithms such as AMLB and TLB algorithms are more flexible and can 
easily offer run time changes ability [26], [31]. The RR algorithm works in a circular arrangement, whereas all 
the VMs are employed, and the load is equally distributed among all servers depending on the time interval. 
The main issue of the RR algorithm is that it directly assigns the task to the VM in sequences without checking 
the capacity of the VM. Furthermore, it does not consider the state of the VM (available or busy) [32], [33]. In 
the AMLB algorithm, the number of requests assigned to each VM is monitored. When a new task arrives, it 
will be allocated to the VM with the least number of tasks. In case of more than one VM is available, the first 
recognized VM is selected, and AMLB returns the VM id to the data center controller (DCC) [34], [35]. 
Besides, TLB is a dynamic algorithm in nature, which assigns all received tasks to the available VMs. It 
determines the suitable VM for assigning a specific task by considering the state of the VM (available or busy) 
stated in the allocation table. When the number of requests is larger than the number of the available VM, the 
requests will be waiting until the VM becomes available [24], [25], [27], [36]. The limitation of TLB is that it 
checks for the available VM in the allocation table starting from the first VM every time, and it does not 
continue from the last allocated VM. Moreover, it does not count the number of the assigned tasks to each VM 
[34]. Based on these observations, the conventional algorithms have some limitations which produce less- 
effective load balancing. Therefore, the potential modification of these algorithms, particularly the TLB 
algorithm would be superior to develop an applicable algorithm for efficient load-balancing in cloud computing 
environment. 

In this work, a two listed throttled algorithm (TLT-LB) is proposed and simulated. The TLT-LB 
algorithm aims at distributing the delivered tasks among the available VMs in an effective way taking into 
account the average processing time and response time. The suggested TLT-LB algorithm is based on the 
modification of the TLB algorithm by classifying the list of the VMs into two lists, namely available VMs and 
busy VMs. Consequently, when the available VM receives a specific task, its status turned into busy, and it is 
moved to the end of the busy VMs list. After performing the required task, the state of the busy VM switched 
to be available at the end of the available VMs list. CloudAnalyst simulation tool was employed to simulate 
the TLT-LB algorithm using two configurations based on different user bases to evaluate the average 
Processing time and Response time. Furthermore, a comparative study between the present TLT-LB algorithm 
and the TLB, RR, and AMLB algorithms is performed in CloudAnalyst considering the main performance 
metrics. The results reveal that the TLT-LB algorithm remarkably improved the load distribution among the 
VMs and minimized the average processing time and response time compared to the TLB, RR, and AMLB. 

The remaining of the paper is organized as follows; section 2 summarizes a selection of the recent 
related studies to illustrate the main concepts of cloud load balancing and its categories. Section 3 describes in 
detail the proposed TLT-LB algorithm to be easily reproduced. Section 4 shows the experimental part for the 
simulation of the proposed algorithm on the CloudAnalyst platform. Section 5 displays the results and 
discussions, providing a clear overview regarding the merits of using the proposed algorithm over the TLB, 
RR, and AMLB algorithms. Finally, in Section 6 the conclusions are demonstrated. 


2. RELATED WORK 

Load balancing in cloud computing systems has been extensively studied over the last decades [35], 
[37]. In this section, some recent research studies on cloud load balancing are highlighted. Sakthivelmurugan 
et al. [38] introduced an algorithm named hospitality load balancing (HLB) algorithm. In the beginning, all 
VMs are available, and there is an index table that contains different VMs and their status 
BUSY/AVAILABLE. When a new task arrives, the capacity and load of all VMs are calculated. Then, it has 
to check the system, whether it is balanced or not. If the load is larger than the maximum capacity of VMs, the 
VMs are grouped into underloaded, overloaded, and balanced VM. To solve the problem of load imbalance, 
the HLB algorithm finds the underloaded VM and overloaded VM as well as sorting them in 
ascending/descending order, and then the tasks are migrated from the overloaded to the underloaded VMs. The 
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migrated task must be assigned to the underloaded VM with the shortest path. Although this algorithm helps 
to achieve low response time, low make span, low task migration time, and handle heterogeneous host, it does 
not consider the status of the VM before task migration. 

Mirobi and Arockiam [39] proposed an enhanced throttled load balancer (ETLB) that allocated the 
workloads uniformly to all VMs. By using the threshold value, the load balancer classified the VMs to 
overloaded, balanced, and under-loaded VMs. In the case of an overloaded VM is found, the ETLB searches 
for an appropriate underloaded VM and automatically sends the task to it, thereby balancing the load on VMs. 
This balancer determines the load of each VM after assigning the task to a VM and then migrates the tasks 
between overloaded and underloaded VMs. This may lead to a decrease in system efficiency and cause a delay 
in achieving the tasks. 

Shetty and Shetty [40] suggested a modified central load balancer (MCLB) algorithm which has a 
table that comprises the ids, status, and priority of the VMs. This algorithm finds the VM with the highest 
priority and which is available for assigning the arrived task. In case of all VMs are busy, the arrived task is 
assigned to the first available VM without considering the priority of this VM, which means that the sequence 
of the algorithm will not be applicable. 

Ghosh and Banerjee [41] suggested a priority-based modified throttled algorithm (PMTA). The idea 
of this algorithm depends on the TLB, which assigns the submitted tasks directly to the available VMs. In case 
of all VMs are busy, the algorithm compares the priority of the new received task to the executing task. A 
Switching queue was proposed to hold the task which has been removed temporarily from the VM due to the 
arrival of a higher priority task. The waiting task resumed the execution after completion of the higher priority 
task. This algorithm suffers from task delay, where some of the paused tasks could be lost or delayed because 
of their low priority. 

Domanal and Reddy [42] proposed a modified throttled algorithm that assigned the incoming tasks 
uniformly to a set of VMs and improved the response time. In this algorithm, the VMs are indexed in a table, 
with status either available or busy similar to the standard TLB algorithm. An available VM is selected for the 
request, and its id is returned to the DC. For processing the following request, the VM that is found next to the 
assigned VM in the table is selected. The choice of the selected VM is depending on the status of the VM 
without parsing the index table from the beginning every time. This study focused on minimizing response 
time without considering the processing time. These studies reveal the influential role of load balancers to 
boost the performance of the cloud computing environment. However, some of these mentioned algorithms do 
not consider the requirements and priorities of the user. For example, some of these algorithms do not monitor 
the resource load during task allocation, which can lead to defeat the task execution and increase the processing 
time and response time. The main objective of this work is to enhance the TLB algorithm by decreasing both 
the processing time and response time. Besides, it effectively improves the load distribution among the VMs. 
In the next section, the proposed TLT-LB is illustrated. 


3. RESEARCH METHOD 
3.1. Proposed TLT-LB algorithm 

The TLB algorithm has several advantages such as simplicity, dynamicity, and effectiveness in terms 
of response time and processing time [25], [27], [34] However, it resolves the VM list from the first VM every 
time, resulting in unequally load distribution. In this paper, a Two Listed Throttled Load Balancing TLT-LB 
algorithm is introduced. TLT-LB distributes the required tasks among the VMs effectively, for improving the 
response time and processing time compared to the conventional TLB, RR and AMLB algorithms. In the 
TLT-LB algorithm, the VMs are categorized into two lists, namely “Available VMs list” and “Busy VMs list”. 
Accordingly, when an available VM delivers a specific task; its status turned into busy and moved to the end 
of the “Busy VMs list”. After execution, the status of the busy VM switched to be available and moved to the 
end of the “Available VMs list”. In the TLT-LB algorithm, the DCC receives all requests from different regions 
and forwards the tasks to TLT-VmLoadBalancer. Then, TLT-VmLoadBalancer allocates the tasks to the 
available VMs. When a new task arrives, the TLT-VmLoadBalancer maintains the “Available VMs list” and 
returns the “id” of the first available VM to the DCC. Then, the TLT-VmLoadBalancer assigns the task to the 
selected VM. If all VMs are busy, the received tasks will be queued, and the DCC waits for the first available 
VM to assign the waited task(s). Then, the allocated VM is removed from the “Available VMs list” and moved 
to the end of the “Busy VMs list”. The basic methodology and steps of the proposed algorithm are shown in 
Figure 1(a) and (b). 


3.2. Simulation 

CloudSim is a toolkit that can be used for modeling, simulation, and scheduling of a large-scaled 
cloud platform [43], [44]. CloudAnalyst simulation packages are developed on CloudSim Toolkit-3.0.3 
architecture. The main components of CloudAnalyst are region, internet, user base, InternetCloudlet, GUI, 
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Cloud Service Broker, VmLoadBalancer, and DCC. These components are explained in Figure 2. In this work, 
CloudAnalyst is employed to analyze the proposed TLT-LB, TLB, RR, and AMLB algorithms because of its 
graphical user interface and high level of visualization [20], [35], [45]. CloudAnalyst package is configured 
using Eclipse IDE for Java Developer 2.0.1 and JDK 1.8.0 on Windows 10 operating system. The model of 
the system comprises one DC which has several homogeneous VMs ‘m’ (VMo, VMi, VM_b....... VMm-1) with 
1000 MB Image size, 512 MB memory, and 1000 MB bandwidth, as well as the number of independent tasks 
‘n’ (Tı, To, T3......Tn). The selected parameters for the proposed TLT-LB algorithm using the two configurations 
are user base, region, peak hour start, peak hour end, and average users at peak and off-peak hours, as shown 
in Table 1 and Table 2, respectively. The DC configurations are X86 architecture, Linux operating system, xen 
virtual machine manager (VMM). The DC contains two physical hardware units. Each physical unit has the 
following configuration: 204800 RAM (MB), 100 storage space (TB), 1000000 available bandwidths, 
4 processors that have a capacity power of 10000 MIPS, and a TIME_SHARED VM scheduling policy. The 
main influential metrics including load-distribution, response time, processing time, and the total cost of total 
VM cost and total data transfer cost are assessed for the proposed TLT-LB algorithm compared to TLB, RR, 
and AMLB algorithms using two configurations. Figures 3 illustrate the snapshot of advanced configuration in 
CloudAnalyst. Moreover, Figure 4 presents a snapshot of the regions used in the simulation. 
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(b) 
Figure 1. The TLT-LB algorithm shown as (a) TLT-LB block diagram and (b) TLT-LB workflow 
The response time, processing time, load-distribution, and the total cost are assessed according to the 


following (1)-(4) [20]. The response time is the time required to respond to a user’s request for service [24] 
and can be calculated using (1): 
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where Tfinish is the finish time of user request, Tarival is the arrival time of user request and Tuelay is the 
transmission delay. Tdelay can be calculated as: 


Taetay = Tiatency t Teransfer 


where Tiatency is the network latency which is the delay time before the beginning of data transfer and Transfer iS 
the time taken to transfer the amount of data of a single request (D) from the source location to the destination 
location. Tiatency is taken from the latency matrix (after applying Poisson distribution). Tiransfer can be calculated 
as follow: 


Transfer =D / BWoeruser and BWperuser re BWrotat /N; 


where BWperuser and BWiotaı are the bandwidth per user and the total available bandwidth (held in the 
InternetCharacteristics class in CloudAnalyst) respectively, while N is the number of user requests currently in 
transmission. The internet characteristics also keeps track of the number of user requests in-flight between two 
regions for the value of N. 

Besides, the average processing time is the time required by the DC to process all the received tasks 
from the users. It is calculated using (2) [46]: 


Processing time = Lyys/Cyms (2) 


where Lyms is the sum of the load on each VM in the DC and Cys is the sum of the capacity of each VM in 
DC. The following formula is used to calculate the capacity of individual VM: 


Cym =p *q 


where Cym is the capacity for only one VM, P is the processing speed of the processor (CPU) in million 
instructions per second and q=number of busy CPU. 
The load distribution (%) is calculated according to (3). 


road distribution wS Number of tasks on VMn siio 
Oaa STOEL ONS Total number of tasks on all VMs (3) 


The total cost is a very important parameter in cloud computing as it is paid on a pay-per-use basis, which 
depends on the percentage of resource utilization [24], [47]. The total cost of processing a task can be calculated 
using (4). 


Total Cost = Transmission cost + Processing cost (4) 


Table 1. Simulation parameters of the first configuration 


User Base Region Peak hour start (GMT) Peak hour end (GMT) _ Avg peak users __ Avg off-peak users 
1 O-N. America 3 9 1000 100 
2 1-S. America 3 9 1000 100 
3 2-Europe 3 9 1000 100 
4 3-Asia 3 9 1000 100 
5 4-Africa 3 9 1000 100 
6 5-Oceania 3 9 1000 100 


Table 2. Simulation parameters of the second configuration 


User Base Region Peak hour start (GMT) Peak hour end (GMT) Avg peak users Avg off-peak users 
1 0-N. America 1 4 235000 23500 
2 1-S. America 4 6 225000 22500 
3 2-Europe 18 21 535000 53500 
4 3-Asia 8 12 755000 75500 
5 4-Africa 21 24 100000 10000 
6 5-Oceania 6 8 170000 17000 
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Components of CloudAnalyst 


GUI: 
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his simulation 
easily. 


Data Center 
Controller (DCC): 


is responsible for 


creation and VMLoadBalancer: 
destruction of VM This component 
and receiving a simulates the different 
managing tasks. load balancing policies 
which are configured by 
the user. 


User Base: 


A User Base models 
a group of users that 
is considered as a 
single unit in the 


simulation. 


Region: 

The world in the 
CloudAnalyst is 
divided in to 6 
‘Regions’ that 
concur with the 6 
main continents in 

the World. 


Internet: 


It has the concept 
for the real world 
Internet, 
implementing only 
the features that are 
important to the 
simulation 


| InternetCloudlet: 


It is a grouping of 
user requests which 
carries information 
such as the size of a 

request execution 
command and size 
of input and output 


files. 


Cloud Application 
Service Broker: 


This component 
decides which Data 
Center should deal 
with the tasks from 

each user base. 


Figure 2. Main components of CloudAnalyst 
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Figure 3. Snapshot of advanced configuration in CloudAnalyst 


Figure 4. Snapshot of the regions used in the simulation 
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4. RESULTS AND PERFORMANCE EVALUATION 

In this section, the simulation results of the TLT-LB algorithm using both the first and second 
configurations are presented to evaluate the performance of the proposed algorithm. The load distribution (%) 
for the TLT-LB algorithm compared to TLB and AMLB algorithms are presented in Figure 5. Interestingly, 
the load among the VMs is significantly distributed using the TLT-LB algorithm compared to TLB, and AMLB 
algorithms. In particular, the difference in the load distribution between the first VM and the last VM using the 
TLT-LB algorithm is in the range of 3-7%. In comparison, the load gap between the first VM and the last VM 
for TLB, and AMLB algorithms is more than 68%, which indicates that some VMs are over-loaded (VMo and 
VM), and the others are under-loaded (VM3 to VMo). These results reveal the applicability and high- 
performance of the TLT-LB algorithm, which decreases the load gap between the first and the last VM from 
68.55% to 6.446% compared to the conventional TLB, and AMLB algorithms. 


a 
o 


Load distribution (%) 
N 
o 


0 1 2 3 4 5 6 7 8 9 
Number of VMs 


Figure 5. The load distribution (%) among the VMs after simulation of TLT-LB, TLB, and AMLB 


The average response time and the average data center processing time are analyzed in milliseconds 
for the TLT-LB, TLB, RR, and AMLB algorithms. The results for the first configuration are shown in 
Figure 6(a) and 6(b). Generally, the average response time increases when the number of VMs increases for 
all the simulated algorithms. Besides, the response time decreases using the TLT-LB algorithm in contrast to 
the other algorithms for different numbers of VMs due to reducing the loading gap between the heaviest loaded 
and the lightest loaded VMs. However, there are no obvious changes in the processing time for the TLT-LB, 
TLB, RR, and AMLB algorithms. Therefore, the simulation conditions are changed by increasing the number 
of users to get more insights about the performance of the TLT-LB algorithm in terms of the average processing 
time related to TLB, RR, and AMBL algorithms. 


293.4 1.4 
( a) E TLTB 13 ( b) TLT-LB 
Ps 293.2 BZA TLB mw Tia ZØ TLB 
£ RR E RR 
D 293.0 AMBL 2” [M amet 
£ = 10 
8 292.8 H 0.9 = 
5 9 0.8 
Qa Q =| 
8 292.6 == o 0.7 
g = @ 06 
D 
g 292.4 = ae 
Š Fia 
< 292.2 < 
= = 0.3 S| 
292.0 0.2 
5 10 25 50 100 5 10 25 50 100 
Number of VMs Number of VMs 
(a) (b) 


Figure 6. The result of different algorithms using the first configuration in (a) the response time and 
(b) processing time 
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Figure 7 illustrates the response time and processing time for the second configuration using 
200 VMs. The response time and processing time considerably decrease for the TLT-LB algorithm compared 
to the other algorithms. As shown in Figure 7(a), the response time after using the TLT-LB algorithm decreases 
by 2.380%, 4.515%, and 2.164% compared to the TLB, RR, and AMLB algorithms respectively. In addition, 
Figures 7(b), (c) show that the processing time for the TLT-LB algorithm sustainably minimizes by 0.454%, 
49.159%, and 40.462% in comparison to TLB, RR, and AMLB algorithms respectively. Figure 7(c) illustrates 
the difference between the TLT-LB and TLB algorithms in terms of processing time. The response time and 
processing time decrease using the second configuration rather than the first one. These results reveal that 
optimizing the conditions and selecting the proper parameters is a crucial step to evaluate the performance of 
different algorithms. Finally, the estimated total cost for the TLT-LB algorithm is $147.93, which equals to its 
counterpart for the TLB, RR, and AMLB algorithms. 
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Figure 7. The result of different algorithms using the second configuration in (a) the response time and (b), (c) 
processing time 


5. CONCLUSION 

The efficiency of task allocation in the cloud environment depends on the efficiency of the load 
balancing algorithm. Therefore, using an adaptable load balancer for a cloud computing environment is a 
critical step to achieve maximum utilization of resources. In this respect, a TLT-LB algorithm is proposed to 
allocate the workload dynamically and effectively among the VMs. Two configurations employing different 
simulation parameters (user bases) are applied to assess the performance of the TLT-LB algorithm concerning 
the average response time, processing time, and cost. The performance of the proposed TLT-LB algorithm is 
compared with three well-known algorithms, namely RR, TLB, and AMLB. The CloudAnalyst package which 
is developed on CloudSim Toolkit-3.0.3 architecture is employed for the simulation process. Results indicate 
the applicability of the proposed TLT-LB algorithm to distribute the tasks among the VMs in an effective way 
since the load difference between the VMs is in the range of 3-7%. Moreover, it significantly reduces the 
average response time and processing time, which leads to an increase in the throughput of the system when 
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comparing to the conventional algorithms. These findings show that the proposed TLT-LB is more practical 
than TLB, RR, and AMLB algorithms for a stable and effective cloud computing environment. In the future, 
we plan to extend this work considering more factors for utilizing the proposed TLT-LB algorithm in healthcare 
systems. 
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